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(54) System and method for multimedia messaging collaboration 

(57) The present invention relates to a system and 
method for multimedia messaging system collaboration. 
According to an embodiment of the present invention, 
the sender sends a message to multiple recipients (200, 
300, 500). A recipient wjshing to make a comment or 
insert changes to the message submits his comments 
to a moderator for approval (202, 302, 502). If the mod- 
erator approves of the changes, then the changes are 
automatically incorporated into thei message (210, 318). 
The original message is then automatically recalled 
from recipients who have not yet opened the rnessage 
and a revised message is automatically sent to those 
who's messages were recalled (212). Additionally, 
according to an embodiment of the present invention, a 
message is autorhatically sent to those recipients who 
have already opened the onginal message to indicate 
the change to the original message and update those 
recipients (214). 


Primed by Xerox (UK) Business Services 
2.16.7/3.6 


1 


EP 0 984 593 A1 


2 


Description 

BACKGROUND OF THE INVENTION 

[OOCDI] The present invention relates to electronic 5 
messaging systems. In particular, the present invention 
relates to multimedia message collaboration. 
[0002] In addition to electronic mail (e-mail) and voice 
mail, today's electronic messaging systems may also 
include multimedia messages. A multimedia message to 
is typically a message that includes more than one 
media. For example, a multimedia message may 
include text, video, audio, and images such as graphs 
and charts. In a multimedia messaging system, the abil- 
ity to exchange e-mails, voicemails, faxes, images and is 
video is part of a basic multimedia system. Examples of 
multimedia messaging systems include ViewMail. 
Phome Max. Repartee, and View Call Plus, all by Active 
Voice. 

[00(D3] A sender may send a multimedia message to 20 
numerous recipients, several of whom may wish to 
make comments or revisions to the multimedia mes- 
sage. For example, a sender may send a multimedia 
message of a proposed presentation for a company 
Some of the recipients of the message may wish to 25 
comment or revise portions of the message. Typically, if 
recipient A makes a comment or a revision to the mes- 
sage, recipient A would return the commented or 
revised message back to the sender. For example, 
assume an incorrect statement is made in the message 30 
and recipient A corrected the statement and returned it 
to the sender. In the meantime, recipients B through 2 
may also have noticed that the statement was incorrect, 
and most of them may correct the statement and return 
the corrected statement to the sender. Since recipients 35 
A - Z would each review the message in their own time, 
the sender may receive multiple comments regarding 
the same incorrect statement over a period of days. 
[OQ04] Alternatively, a recipient of the multimedia mes- 
sage may feel compelled to forward his comments to all 40 
the recipients and sender for discussion and agree- 
ment. All responses to those comments are also likely 
to be sent to recipients and sender. Accordingly, it is 
likely that all recipients and sender have multiple mes- 
sages with regard to the same issue. The cumulative 45 
time lost on the matter of a single message may be sub- 
stantial. 

[0005] It would be desirable to have a multimedia 
messaging system which collaborates comments and 
revisions while minimizing time wasted reading obsolete so 
messages. 

SURflMARY OF THE IMVEMTIOM 

[0006] The present invention relates to a system and ss 
method for multimedia messaging system collaboration. 
According to an embodiment of the present invention, 
the sender sends a message to multiple recipients. A 


recipient wishing to make a comment or insert changes 
to the message submits his comments to a moderator 
for approval. If the moderator approves of the changes, 
then the changes are automatically . incorporated into 
the message. The original message is then automati- 
cally recalled from recipients who have not yet opened 
the message and a revised message is automatically 
sent to those whose messages were recalled. Addition- 
ally, according to an embodiment of the present inven- 
tion, a message is automatically sent to those recipients 
who have already opened the original message to indi- 
cate the change to the original message and update 
those recipients. 

[0007] According to an embodiment of the present 
invention, a vote may also be called to determine 
whether a revision of the message should be accepted. 
If the vote accepts the change, then the revisions are 
automatically incorporated into the message and recip- 
ients who have not yet opened their original message 
will automatically have their original message recalled 
and automatically have an updated version of the mes- 
sage sent to them. 

[0008] According to an embodiment of the invention, 
a method for collaboration of an electronic hiessage is 
presented. The method includes receiving a proposal 
associated with an issued electronic message and 
determining whether the proposal is approved. The 
method also automatically recalls the electronic mes- 
sage from a recipient who has not yet opened the elec- 
tronic message, wherein the automatic recalling of the 
electronic message is performed if the proposal is 
approved. 

[0009] In another embodiment , the present invention 
provides a system for collaboration of an electronic 
message. The system includes a network interface con- 
figured to receive a proposal associated with ah issued 
electronic message and a user interface configured to 
receive an instruction on whether the proposal is 
approved. The system also includes a processor cou- 
pled with the network interface, wherein the processor 
is configured to automatically recall the electronic mes- 
sage from a recipient who has not yet opened the elec- 
tronic message if the proposal is approved. 
[0010] These and other embodiments of the present 
invention are described in further detail below with refer- 
ence to the following drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0011] 

Figure 1 is a block diagram of a computer system 
suitable for implementing an embodiment of the 
present invention. 

Figure 2 is a block diagram of a flow diagram of a 
method according to an embodiment of the present 
invention for collaboration of a multimedia mes- 
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sage. 

Figure 3 is a method for collaboration of a multime- 
dia message according to an embodiment of the 
present invention. 

Figure 4 is a flow diagram of a method for calling a 
vote according to an embodiment of the present 
invention. 

Figure 5 is a flow diagram of a method for collabo- 
ration of a multimedia message according to an 
embodiment of the present invention. 

DETAILED DESCRIPTION OF THE SPECIFIC 
EMBODIMENTS 

[0012] A method and system for collaboration of a 
multimedia message is herein disclosed. Software writ- 
ten according to the present invention may be stored in 
some form of computer-readable medium, such as 
memory or CD-ROM, or transmitted over a network, 
and executed by a processor. The present invention 
applies generally to multimedia messaging systems (for 
example, an H.323 system). 

[0013] Figure 1 is a block diagram of a general pur- 
pose computer system ICQ suitable for carrying out the 
processing in accordance with one embodiment of the 
present invention. Figure 1 illustrates one embodiment 
of a general purpose computer system. Other computer 
system architectures and configurations can be used for 
carrying out the processing of the present invention. 
Computer system 100. made up of various subsystems 
described below, includes at least one microprocessor 
subsystem (also referred to as a central processing unit, 
or CPU) 102. That is. CPU 102 can be implemented by 
a single-chip processor or by multiple processors. CPU 
102 is a general purpose digital processor which con- 
trols the operation of the computer system 100. Using 
instructions retrieved from memory 110, the CPU 102 
controls the reception and manipulation of input data, 
and the output and display of data on output devices. 
[0014] CPU 102 Is coupled bi-directionally with mem- 
ory 110 which can Include a first primary storage, typi- 
cally a random access memory (RAM), and a second 
primary storage area, typically a read-only memory 
(ROM). As is well known in the art, primary storage can 
be used as a general storage area and as scratch-pad 
memory, and can also be used to store input data and 
processed data. It can also store programming instruc- 
tions and data. In the form of data objects and text 
objects, in addition to other data and instructions for 
processes operating on CPU 1 02. Also as well known In 
the art, primary storage typically Includes basic operat- 
ing instructions, program code, data and objects used 
by the CPU 102 to perform its functions. Primary stor- 
age devices 110 may include any suitable computer- 
readable storage media, described below, depending 
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on whether, for example, data access needs to be bi- 
directional or uni-directlonal. CPU 102 can also directly 
and very rapidly retrieve and store frequently needed 
data in a cache memory (not shown). 

5 (001 5] A removable mass storage device 1 1 2 provides 
additional data storage capacity for the computer sys- 
tem 100. and is coupled either bi-directionally or uni- 
directionally to CPU 102. For example, a specific 
removable mass storage device commonly known as a 

10 CD-ROM typically passes data unl-dlrectionally to the 
CPU 102. whereas a floppy disk can pass data bi-direc- 
tionally to the CPU 102. Storage 112 may also include 
computer-readable media such as magnetic tape, flash 
memory, signals embodied on a carrier wave. PC- 

15 CARDS, portable mass storage deviceis, holographic 
storage devices, and other storage devices. A fixed 
mass storage 120 can also provide additional data stor- 
age capacity. The most common example of mass stor- 
age 120 is a hard disk drive. Mass storage 112. 120 

20 generally store additional programming instructions, 
data, and the like that typically are not In active use by 
the CPU 102. It will be appreciated that the information 
retained within mass storage 112, 120 may be Incorpo- 
rated, if needed, in standard fashion as part of primary 

25 Storage 110 (e.g. RAM) as virtual memory 

[0016] In addition to providing CPU 102 access to 
storage subsystems, bus 114 can be used to provide 
access other subsystems and devices as well. In the 
described embodiment, these can Include a display 

30 monitor 118i a network Interface 116, a keyboard 104, 
and a pointing device 106, as well as an auxiliary 
input/output device interface, a sound card, speakers, 
and other subsystems as needed. The pointing device 
106 may be a mouse, stylus, track ball, touchpad. or 

35 tablet, and is useful for interacting with a graphical user 
interface. ■'%■■■•'■■ 
[0017] The network interface 1 16 allows CPU 102 to 
be coupled to another computer, computer network, or 
telecommunications network using a network connec- 

40 tion as shown. Through the network Interface 116, It is 
contemplated that the CPU 102 might receive informa- 
tion. e.g„ data objects or program instructions, from 
another network, or might output information to another 
network In the course of performing the above- 

45 described method steps. Information, often represented 
as a sequence of instructions to be executed on a CPU. 
may be received from and outputted to another network, 
for example, In the form of a computer data signal 
embodied in a carrier wave. An Interface card or similar 

50 device and appropriate software Implemented by CPU 
1 02 can be used to connect the computer system 1 00 to 
an external network and transfer data according to 
standard protocols. That Is, method embodiments of the 
present invention may execute solely upon CPU 102i or 

55 may be performed across a network such as the Inter- 
net, intranet networks, or local area networks, in con- 
junction with a remote CPU that shares a portion of the 
processing. Additional mass storage devices (not 
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shown) may also be connected to CPU 1 02 through net- 
work interface 116. 

[001 8] An auxiliary I/O device interface (not shown) 
can be used in conjunction with computer system 100. 
The auxiliary I/O device interface can include general s 
and customized interfaces that allow the CPU 102 to 
send and, more typically, receive data from other 
devices such as microphones, touch-sensitive displays, 
transducer card readers, tape readers, voice or hand- 
writing recognizers, biometrics readers, carneras, porta- io 
ble mass storage devices, and other computers. 
[001 9] In addition, embodiments of the present inven- 
tion further relate to computer storage products with a 
computer readable medium that contain program code 
for performing various computer-implemented opera- is 
tions. The computer-readable medium is any data stor- 
age device that can store data which can thereafter be 
read! by a computer system. The media and program 
code may be those specially designed and constructed 
for tihe purposes of the present invention, or they may 20 
be of the kind well known to those of ordinary skill in the 
computer software arts. Examples of computer-reada- 
ble media include, but are not limited to, all the media 
mentioned above: magnetic media such as hard disks, 
floppy disks, and magnetic tape; optical media such as 25 
CD-ROM disks; magneto-optical media such as floptical 
disks; and specially configured hardware devices such 
as application-specific integrated circuits (ASICs), pro- 
grammable logic devices (PLDs), and ROM and RAM 
devices. The computer-readable medium can also be 30 
distributed as a data signal embodied in a carrier wave 
over a network of coupled computer systems so that the 
computer-readable code is stored and executed in a 
distributed fashion. Examples of program code include 
both machine code, as produced, for example, by a 35 
compiler, or files containing higher level code that may 
be executed using an interpreter. 
[OQ20] The computer system shown in Figure 1 is but 
an example of a computer system suitable for use with 
the invention. Other computer systems suitable for use 40 
with the invention may include additional or fewer sub- 
systems. In addition, bus 1 14 is illustrative of any Inter- 
connection scheme serving to link the subsystems. 
Other computer architectures having different configu- 
rations of subsystems may also be utilized. 45 
[0021 ] Figure 2 is a flow diagram of a method for col- 
laborating on a multimedia message according to an 
embodiment of the present invention. A sender sends a 
multirnedia message to numerous recipients (step 200). 
A receiver receives the message and inserts changes in so 
the message (step 202). For exemplary purposes, it is 
assumed that the receiver inserts changes in the mes- 
sage, however, the receiver may make any proposal 
regarding the message. Examples of prqDosals include 
a change, comments, or appending the original mes- 55 
sage in various ways. For example, the receiver may 
append a voice message to the original message, insert 
an image, or generally make comments in video, audio. 


text, or any other media which may be used in the mul- 
timedia message. 

[0022] The proposed change is then submitted to a 
moderator for approval (step 204), The moderator may 
be the sender or a third party, such as the manager of a 
project to which the multimedia message relates. It is 
then determined whether the moderator approves of the 
proposed change (step 206). If the moderator does not 
approve of the proposed change, then the change is 
rejected and not incorporated into the message (step 
208). A notification of the rejection of the change, along 
with optional comments may be sent to the sender (if 
the sender is not the moderator) and the receiver who 
proposed the change (step 208). It however, the moder- 
ator approves of the change, then the change is auto- 
matically incorporated into the message (step 210). 
[0023] The original message is then automatically 
recalled from those recipients who have not yet opened 
the original message and a revised message is sent to 
those recipients whose message was recalled (step 
212). An update message indicating the change to the 
original message is then automatically sent to those 
who have already opened the original message (step 
214). 

[0024] Figure 3 is a flow diagram of a method for col- 
laborating on a multimedia message, according to 
another embodiment of the present invention. A sender 
initially sends a multimedia message to numerous 
recipients (step 300). One of the recipients appends a 
voice message to the end of the original message as a 
voice attachment (step 302). Although a voice message 
is used in this example, any modification to the original 
message or comment regarding the original message 
may be authored by a recipient, as previously discussed 
in conjunction with Figure 2. 

[0025] The revised message is then submitted to a 
moderator for approval (step 304). As previously men- 
tioned, the moderator may be the sender or any person 
selected to moderate this particular message. 
[0026] It is then determined whether to call a vote 
(step 306). The vote may be called by any person or 
persons. For example, the vote may be called by the 
moderator, the sender, or the receiver who revised the 
niessage. If no vote is called, then it is determined 
whether the message revision is accepted by the mod- 
erator (step 308). If the revision is not accepted, the 
message revision is rejected (step 310). A notification of 
the rejection of the revision, along with optional com- 
ments may be sent to the sender (if the sender is not the 
moderator) and the receiver who proposed the revision 
(step 310). If. however, the message revision is 
accepted in step 308 then the revisions to the message 
are automatically incorporated in step 210 of Figure 2. 
Thereafter, the original messages are automatically 
recalled from those recipients who have not yet opened 
the messages and a revised message is then sent to 
those whose message was recalled (step 212 of Figure 
2). A message updating those who have already 
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opened their original message is also automatically 
sent (step 214 of Figure 2). 

[0027] If a vote is called in step 306 of Figure 3. then 
the results of the vote are determined (step 312). Fur- 
ther details of the voting process will later be discussed 
in conjunction with Figure 4. It is then determined 
\A^ether the message revision has been voted to be 
i ncorporated into the message (step 314). If the revision 
was voted not to be incorporated, then the changes to 
the original message are rejected (step 316). A notifica- 
tion of the rejection of the change, along with optional 
comments may be sent to the sender (if the sender is 
not the moderator) and the receiver who proposed the 
change (step 316). If, however, the revision to the origi- 
nal message was voted to be incorporated in step 314. 
then the changes to the original message are incorpo- 
rated (step 318). Thereafter, the system goes to step 
212 of Figure 2 wherein the original message is auto- 
matically recalled from those recipients who have not 
yet opened it and a revised message is sent to those 
whose message was recalled. A message is also auto- 
matically, sent to those who have already opened the 
original message to update these recipients on the 
changes to the original document (step 214 of Figure 2). 
[0028] Figure 4 is a flow diagram of a method of vot- 
ing, according to an embodiment of the present inven- 
tion. The method shown in Figure 4 is related to steps 
306 and 312 of Figure 3 wherein it is determined 
whether a vote is called, and if so determining the 
results of the vote. Examples of programs which may 
facilitate voting messages include Microsoft Outlook 
and Microsoft Exchange. 

[0029] Initially, a vote is called (step 400). A message 
indicating that a vote has been called is sent to all recip- 
ients of the original message (step 402). This message 
indicating that a vote has been called should include 
voting choices. The recipients may then vote and send 
their vote to a predetermined individual, such as the 
moderator or the vote caller (step 404) . 
[0030] Figure 5 is a f low diagram of a method for col- 
laboration of a multimedia message according to 
another embodiment of the present invention. In this 
embodiment, the multimedia message may have two or 
more people who manage the multimedia message. For 
example, in a group work environment, one employee 
may have generated the image portion of the multime- 
dia message, such as graphs and charts, while another 
employee may have generated the audio portion of the 
multimedia message, such as narration and back- 
ground music. Accordingly, the first employee may be 
designated as the manager for the image portion of the 
multimedia message, while the second enrtployee is 
designated as ttie manager for the audio portion of the 
multimedia message. 

[0031 ] A sender, such as a group secretary, sends the 
original multimedia message to multiple recipients (step 
500), One of the receivers makes a change to the mes- 
sage (step 502). The change is then submitted to a 


moderator, such as the group supervisor, for approval 
(step 504). When the receiver submits the change to the 
moderator, the receiver may have the option to identify 
what portion of the message he is making a change or 

5 comment to. For example, if the message has a man- 
ager for images and another manager for audio, then a 
comments/change form may be sent along with the 
message wherein the receiver may select a portion of 
the message, such as image or audio, to which he is 

w making his comments/changes. It is then automatically 
determined which manaiger is associated with this par- 
ticular change (step 506). For example, if the proposed 
change is related to the audio portion of the multimedia 
message then the manager responsible for the audio 

75 portion will automatically be determined. 

[0032] If the receiver proposing the change does not 
identify the portion of the message to which his change 
applies, then the proposal may be submitted to the 
moderator who can identify which portion of the mes- 

20 sage is related to the change. Alternatively, the modera- 
tor may directly identify the manager responsible for the 
portion of the message related to the change. 
[0033] The proposed change js then automatically 
submitted to the responsible manager (step 508). 

25 Thereafter, either the method exemplified in Figure 3,' 
wherein a vote may be called, or the method exemplified 
in Figure 2 may be utilized. For illustrative purposes, the 
flow diagram of Rgure 5 shows that a vote may be 
called. Accordingly, it is then determined whether to call 

30 a vote (step 510). If a vote is not called; then it is deter- 
mined by the selected manager whether to accept this 
proposed change (step 512). If the proposed change is 
not accepted, then a rejection is sent to the^receiver 
who proposed the change and the moderator, along 

35 with optional comments (step 514). 

[0034] if, however, the manager decides to accept the 
proposed change in step 512, then an acceptance of 
the proposed change is sent to the receiver vCrho pro- 
posed the change and the moderator (step 520): There- 
to after, the system proceeds to step 210 of Figure 2, 
wherein the changes are automatically incorporated. 
[0035] If a vote is called in step 510, then it is deter- 
mined whether the proposed change has been voted to 
be incorporated into the multimedia message (step 

45 518). If the vote is against incorporating the change, 
then the receiver who proposed the change and the 
moderator are notified that the change has been voted 
not to be incorporated (step 516). If. however, the result 
of the vote is to incorporate the change, then the 

50 receiver who proposed the change and the moderator 
are then notified that the change is to be incorporated 
into the multimedia message (step 522). Thereafter, the 
system proceeds to step 210 of Figure 2. wherein the 
change is automatically incorporated into the multirhe- 

55 dia message. 

[0036] Although the present invention has been 
described in accordance with the embodiment shown, 
one of ordinary skill in the art will readily recognize that 
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ther« could be variations to the embodiment and these 
variations would be within the spirit and scope of the 
present invention. Accordingly, many modifications may 
be made by one of ordinary skill in the art without 
departing from the spirit and scope of the appended 5 
claims. 

Claims 

1. A method for collaboration of an electronic mes- 10 
sage comprising: 


receiving a proposal associated with an issued 
electronic message (204, 302, 502); 
determining whether the proposal is approved 
(206. 306, 308, 510. 512); and 
automatically recalling the electronic message 
from a recipient who has not yet opened the 
electronic message, wherein the automatic 
recalling of the electronic message Is per- 
formed if the proposal is approved (212). 

2. The rriethod of claim 1 , wherein the electronic mes- 
sage is a multimedia message. 

3. The method of claim 1, wherein the proposal may 
be approved by a moderator (206, 308, 504. or by a 
manager, wherein the manager Is responsible for a 
portion of the electronic message (508). 

4. The method of claim 1 , further comprising automat- 
ically incorporating the proposal If the proposal Is 
approved (210). 

5. The method of claim 1 , further comprising automat^ 
ically sending a second electronic message Incor- 
porating .the proposal to the recipient, wherein the 
automatic sending of the second electronic mes- 
sage is performed if the proposal is approved (212). 

6- The method pf claim 1 . further comprising sending 
a second electronic message to a second recipient, 
wherein the second recipient has already opened 
the first electronic message, and wherein sending 
the second electronic message Is performed if the 
proposal is approved (214), wherein the second 
electronic message indicates incorporation of the 
proposal Into the electronic message (214). 

7. The method of claim 1, wherein determining 
whether the proposal Is approved Includes a vote 
(306,510). 

8. The method of claim 1. wherein the determination 
of whether the proposal is approved Includes auto- 
matically determining a manager associated with 
the proposal (506). 


20 


25 


30 


A system for collaboration of an electronic message 
comprising: 

means (116) for receiving a proposal associ- 
ated with an issued electronic message; 
means (104,106. 102) for determining whether 
the proposal is approved; and 
means (102, 110, 112, 120) for automatically 
recalling the electronic message from a recipi- 
ent who has not yet opened the electronic mes- 
sage, wherein the automatic recalling of the 
electronic message is performed if the pro- 
posal is approved. 


15 1 0. The system of claim 9 further comprising: 


a user interface (104. 106, or 118) configured 
to receive an instruction on whether the pro- 
posal Is approved; and 

wherein said receiving means comprises a net- 
work Interface (116); and 
wherein said determining means includes a 
processor (102) coupled with the network inter- 
face (116). 


11. TTie system of claim 10. wherein the electronic 
message Is a multimedia message. 

12. The system of claim 10, wherein the proposal may 
be approved by a moderator or by a manager, 
wherein the manager is responsible for a portion of 
the electronic message. 


13. The system of claim 10. wherein said recalling 
35 means automatically Incorporates the proposal if 

the proposal Is approved. 

14. Tlie system of claim 10, wherein said recalling 
means automatically sends a second electronic 

40 message incorporating the proposal to the recipi- 
ent, wherein the automatic sending of the second 
electronic message Is performed if the proposal is 
approved. 

45 15. The system of claim 10. wherein said recalling 
means sends a second electronic message to a 
second recipient, wherein the second recipient has 
already opened the first electronic message, and 
wherein sending the second electronic message is 

50 performed If the proposal is approved. 

16. The system of claim 10. wherein determining 
whether the proposal is approved includes a vote. 
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SENDER SENDS A MESSAGE 


200 


RECEIVER RECEIVES MESSAGE AND 
INSERTS CHANGES IN MESSAGE 


202 


CHANGE IS SUBMITTED TO MODERATOR 
FOR APPROVAL 


204 
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CHANGES ARE REJECTED 
AND NOTIFICATION IS SENT 
TO RECEIVE WHO 
SUBMITTED CHANGE 


YES 


AUTOMATICALLY INCORPORATE CHANGES 
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AUTOMATICALLY RECALL MESSAGE FROM 
THOSE WHO HAVE NOT YET OPENED IT AND 
SEND REVISED MESSAGE TO THOSE 
WHOSE MESSAGE WAS RECALLED 
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AUTOMATICALLY SEND MESSAGE TO THOSE 

WHO HAVE ALREADY OPENED ORIGINAL 
MESSAGE TO INDICATE CHANGE (UPDATE) 


214 


FIG. 2 
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SENDER SENDS A MULTIMEDIA MESSAGE 


300 


RECEIVER APPENDS A VOICE MESSAGE 
TO END OF MESSAGE 
(VOICE ATTACHMENT) 
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REVISED MESSAGE IS SUBMITTED TO 
MODERATOR FOR APPROVAL 
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